High-resolution scalar quantization with Rényi entropy constraint
نویسندگان
چکیده
We consider optimal scalar quantization with rth power distortion and constrained Rényi entropy of order α. For sources with absolutely continuous distributions the high rate asymptotics of the quantizer distortion has long been known for α = 0 (fixed-rate quantization) and α = 1 (entropyconstrained quantization). These results have recently been extended to quantization with Rényi entropy constraint of order α ≥ r+1. Here we consider the more challenging case α ∈ [−∞, 0)∪(0, 1) and for a large class of absolutely continuous source distributions we determine the sharp asymptotics of the optimal quantization distortion. The achievability proof is based on finding (asymptotically) optimal quantizers via the companding approach, and is thus constructive.
منابع مشابه
Entropy Density and Mismatch in High-Rate Scalar Quantization with Renyi Entropy Constraint
Properties of scalar quantization with rth power distortion and constrained Rényi entropy of order α ∈ (0, 1) are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the Rényi entropy due to source values in a fixed interval is identified in terms of the “entropy density” of the quantizer sequence. This extends results related to the well-known po...
متن کاملCodecell Contiguity in Optimal Fixed-Rate and Entropy-Constrained Network Scalar Quantizers
We consider the properties of optimal xed-rate and entropy-constrained scalar quantizers for nite alphabet sources. In particular, w econsider conditions under which the optimal scalar quantizer with contiguous codecells achieves performance no worse than the optimal scalar quantizer without the constraint of codecell contiguit y.In addition to traditional scalar quantizers, w econsider multi-r...
متن کاملCalculation of an entropy-constrained quantizer for exponentially damped sinudoids parameters
The Exponentially Damped Sinusoids (EDS) model can efficiently represent real-world audio signals. In the context of low bit rate parametric audio coding, the EDS model could bring a significant improvement over classical sinusoidal models. The inclusion of an additional damping parameter calls for a specific quantization scheme. In this report, we describe a new jointscalar quantization scheme...
متن کاملError Bounds for High-resolution Quantization with Rényi-α-entropy Constraints
We consider the problem of optimal quantization with norm exponent r > 0 for Borel probability measures on R under constrained Rényi-αentropy of the quantizers. If the bound on the entropy becomes large, then sharp asymptotics for the optimal quantization error are well-known in the special cases α = 0 (memory-constrained quantization) and α = 1 (Shannon-entropy-constrained quantization). In th...
متن کاملLow-Delay Distributed Source Coding: Bounds and Performance of Practical Codes
The performance of distributed source coding methods based on scalar quantization followed by scalar entropy coding is investigated. For a fixed quantizer, the problem is converted to that of zero-error entropy coding for bipartite graphs with a special structure. It is then experimentally shown that for bipartite graphs corresponding to jointly Gaussian sources and high-resolution uniform quan...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Information Theory
دوره 57 شماره
صفحات -
تاریخ انتشار 2011